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ABSTBICT 

I This study .^as undertaken to measure the reading^ 

writing^ and numeration of 10 and 14 year*old students^ and to 
collect inforaation on teacher perceptions of the nature and extent 
of any learning difficulties experienced by indlTidual stmdents« i 
sample of 7,000 students tos tested at each of the two age leTels* 
Beading^ writing nuseration, and word knowledge tests were 
administered. Findings indicate that lustralian children differ 
little in their ability on tasks of reading comprehension from their 
age^mates in Britain and the United States^ but are marcrinally 
inferior to students in Hew Zealand* In general , the writing of 
formal letters was poorly performed, and half o£ the students aged 14 
years old were unable to write a minimal letter applying for 
employment. In numeration^ Australian 14-year*olds performed no 
better than 13^year*olds in the United States* Students aged 10 years 
could not calculate correctly when using the four operations in a 
formal way*. If a student does not master the basic skills before age 
15, when he can legally leaTe school, he will be disadvantaged for 
the remainder of his life* (luthor/JLLJ 
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LITERACY AND NUMERACY 
IN AUSTRALIAN SCHOOLS 

Interim Report No, 1, 1976. 

The Austraf/an Study of School Performance (ASSP Project) was undertaken to 
measure the reading, writing and numeration performance of ten and fourteen- 
year-old students and to collect information on teacher perceptions of the nature 
and extent of any learning difficulties experienced by individual students. The 
project was funded by the Educational Research and Developmental Committee 
(ERDC) with the support of all State and Territory Departments of Education, 
The Interim Report has buen presented by the Australian Council for Educational 
Research, 
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BACKGROUND AND TERMS OF REFERENCE 
A Concern for Literacy 

Across the world, in recent years, there has been a growing 
concern for the achievement of literacy. The recent reports 
from Britain = A iMngimgc for lAfe (Bullock, 1975) and 
from the United States ^ Towards a IJterate Society 
(Carroll and Chall, 1975) revea! an awareness that there are' 
substantial numbers of adults in these countries who cannot 
read. The reports of the Australian Schools Commission 
(Karmei, 1973 and McKinnon, 1975) have acknowledged as 
a basic value that all children (primary and sacondary) 
should attain minimum standards of competence for life in 
a modern, democratic, industrial society. They do not 
acknowledge that a problem currently exists within Aust- 
ralian schools with regard to the achievement of literacy. 

By 1933 it was argued that under the system of 
compursory education the number of persons who reached 
maturity without beiiig able to read or write in any lang- 
uage was extremely small. But the influx of non-English 
ipeaklng migrants into Australia after 1945 may have led to 
a deterioration in the situation, and it would now appear 
meaningful to ask again, after an interval of 50 years, 
whither in Australia today there are significant numbers, 
even thou^ they may be only a small percentage of the 
total, who are not able to read and write in English* 



If, after nine years of compulsory schooling, students 
were unable to read and write effectively, it would be un- 
likely that they would acquire these skills, which are of 
importance in our society, soon after leaving schooL 

The Aims of the Survey 

1. To identify specific tasks and competencies associated 
with the basic skills of literacy and numeracy which 
children are expected to possess to enable them to 
participate successfully in the work of the school and 
to live and work effectively in Australian society. 

2. To prepare appropriate performance tests to measure 
levels of competence in the basic skUls of reading, 
writing and numeration. 

3. To estimate yith a high level of accuracy for Australia 
as a whole, and for each State in particular, the numb^ 
of chUdren who are failing to attain basic .skills of 
literacy and numeracy as assessed by the tests' of read^ 
ing, writing and numeration, 

4. To specify relationships between various other factors 
(age, grade, type of community, specific learning 
difnculties, ethnic origin, language of home, socio- 
educational level and sex) and the attainment of 
specific levels of competence in the basic skills of 
reading, writing and numeration.. 



WHAT IS UTERACY? 

An operadoml definiiion of literacy is the completion uf 
six years of sehooHng, 

An alternative definition, based on achievemeni, is 
the level of achievenienl reached by the averaga child at 
the beginning of the fourth grade of schooling. 

Tlie definition used by the compilers of the report 
is the one submitted by Unesco to the U.N, General 
Assembly in 1963: 

A penon is i iterate w/ien he has acquired the essential 
knowledge and skills which enable him to engage in all 
those activjties in which literacy is, required for effective 
functioning in his group and community, and whose 
attainments in reading, writing and arithmetic make it 
possible for him to continue to use these skills towards 
his own and the community 's development and for active 
participation in the life of his country. 



HOW WAS LITERACY MEASURED? 

In this study a decision was rnade at the outset to avoid 
the use of the readily available tests of readmg and arith- 
metic as they had been constructed as normative inslru^ 
ments. Those approaches to assessment which employed 
the average level of performance of an age or grade group 
were also rejected, 

Tlie Writing and Trial of the Items 

It was argued that a speeded test was inappropriate for 
tesiing literacy or numeracy even for the slower students. 
\Vhere possible, students were given separate time units 
.for each section of the test. / 

Students were asked to record the response beside each 
question on the test booklet which imposed a heavy burden 
of hand scoring the tests during the processing of the data. 

WheTever possible, pictorial or diagrammatic stimulus 
material was used to simplify the task of responding for the 
student who was not a strong reader, 

Tlie Reading Tests 

ITie tests for both the ten- and fourtecn-yeapolds were niade 
up of five sections. Each section was timed and overall time 
QUowed was approximately thirty minutes. 

Section I 

This section consisted of the aiphabet with six letters 
missing. Error types in completing Itie alphabet were re- 
corded in addition to the number of letters correct. 

Section 2 

Five sirTiple sentences, each with four associated 
pictures, were presented. Students were asked to indicate 
which of the pictures was described by the sentence. This 
section measured a basic level of reading: sentences ranged 
from *Tiie boy s^^w a fish hi the rish bowl' to *The woman 
was surprised to see the horse inside^ Sentences and pictures 
were the same for the tests at both levels. 

Section .? 

To test linpiistic competence, students were asked to com- 
plete seven sentences by selecting the correct word or 
phrase from three alternatives offered in each case. For 
example, one sentence was; 
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a is . 

The news '-^ were bad today, 

arc 

It may be that chUdren from non-English backgrounds have 
particular difficulty with these types of items. Another item 
in this group was associated with word order. 
For example, 

o in the afternoon study never. 
The children □ study in the afternoon never* 

□ never study in the afternoon. 

The items in this section were the same for both reading 
tests. 

Section 4 

This section consisted of a reading comprehension exercise 
using different passages and questions for each test. As the 
exercises were taken from the 1970 lEA tests^ comparisons 
of the performance of Australian students with those in 
other English-speaking countries w]ji be possible. 

Section 5 

A newspaperj especially prepared for the reading tests, was 
pven to students who were required to answer questions 
about articles in it. In some cases students simply had to 
find a particular piece of news^ in other cases they had to 
find specific information in an article, and for a few 
questions, interpretation of the meaning of words or 
phrases was required. For the ten-year-old test the news- 
paper was a double-sided tabloid sheet; for the fourteen- 
year^old test, two double-sided tabloid sheets were used. 
Thus two pages of the newspaper and some questions 
asked w^re common to both tests. 



The Writing Tests 

Students require several minutes to complete an item on a 
writing test. Consequently only a few objectives could be 
measured jji^ a writing test of about 30 minutes duration. It 
was considered that 13 or 14 writing objectives identified 
shoLild be measured for bpth samples and this was achieved 
by having three different tests (forms A, B and C) at both 
the 10^ and 14'year*old levels. The resultant reduction in 
sample size from about 7000 to about 2300 at each level 
was accepted as a necessary corollar>' of lesting all the key 
writing objectives in a 30 minute test; 

Items varied from the utilitarian eompletion of a 
form^ through writing informal and forrnal letters, to asking 
students to write about therpselves. Thesft latter items re- 
quired the ten^y ear-old children to write Libout how they 
have fun with their friends and fourteen-year-oids to write 
about their experiences of being alone. Photographs and 
other stimulus materials were used m an effort to attract 
and sustain the interest of students. 

Narking of two types was used in evaluating answers 
to the writing test. Some items were capable of objective 
marking for specific requirements, e.g. the form completion 
and transcription exercises. Other items were impression 
marked on general writing abilityj e.g. the -write about 
yourself items. Some items were marked by both methods 
independentiyi e.g. some of the reports and some of ihe 
letters. 



The Numeration Tests 

Buth the ten- and fourteen-year-old numeration tests 
contained 33 items of which a small number vverfi 
multipli choice and the remainder required students to 
calculate an answer and construct a response. Students 
had 30 minutes to complete the numeration test and, 
^th few exceptions, this was ample, Many of the 
numaration test items are based upon one type of 
arithmetical operation. The results of the four sub- 
tests "so fonned wfll be of interest. Tlie items were de- 
signed to be as relevant and as meaningful as possible 
and this was done by using iilustratlons and other 
diagrammatic stiinulus material. 

The Word Knowledge Tests 

A 10 minute word knowledge test was also administered 
to students* The test consisted of 40 pairs of words and 
students were asked to identify whether each pair of words 
had apprDxlmately the same or opposite maaninp. Tlie 
tests, which differed for the Jen^ and fourteen-year-old 
Students, ware taken from the 1970 lEA survey. Perform- 
ance on the word knowledge tests will be used as a refer- 
ence variable to relate the samples of students in this 
study to each other and to the samples used in the lEA 
ittidy. 

The Student Questionnaire 

litis questionnaire sou^t some general infomiation about 
each student such as family size, whether he had a twin, 
number of schools attended and otlier information specific- 
ally related to migrancy, e,g, countiy of birth of himself ^ 
and his parents, years lived in Australia and some details 
of lan|uages used in the home, 

Teachers supervising the completion of this question- 
naire were asked to give any assistance needed to have it 
completed accurately--even to the extent of completing it 
themselvas from oral answers obtained from students if 
necessary, 

TTie Teacher Questionnaire 

A teacher who knew each student well, in primary schools 
normally the class teacher,, was arked to complete a 
questionnaire consisting of one dauble»sided sheet on 
various aspects related to the student's attendancej, per- 
fofmance in reading and number, relationships with peers, 
sickness or other physical disabflities, understanding and 
use of language^ and race. Most of the questions were 
concerned with the teacher's pergeptions^ of the student's 
learning or social problems. In some cases these percept- 
ions will be .compared with actual student performance 
on the tests, in other cases they will be used as variables 
which assist . in an explanation of suidant perfonnance. 



SCOPE 

The Population and the Samples 
The age levels selected were: 

Agff 10,00 ia J J,00 years% during the middle primary schooi 
period where the basic skOis of literacy ^nd nunieracyj 
which influenca to a major extern all further learnings 
^ould have been acquired, 



Age 14,00 to 14 J 1 years, during the middle secondaty 
school stage at a level immediately prior to Lhe end of the 
period of compulsoiy schooling, where all students were 
still at school/ 

^ A complication rose in the Northern Territory. In 
1975 schooling in RT, was still disrupted by the effects 
of the cyclone which devastated Darwin on 25 December 
1974. 

TTie schools were classified for the investigation: 

1, Government mitropoUtan schools 

2, Government non-metropolitan primary/secondary 
schools 

3, Government non*metropolitan schools 

4. Catholic Systemic metropolitan schools 

5, Catholic Systemic non-metropolitan schools 

6. Independent Catholic matropolitan schools 

7. Independent Non'Catholic metropplitan schools 

8, Independesit Catholic non-metroiopolitan schools 

9. independent Non-Catholic non^metropolitan schools 

10. Aboriginal schools (Northern Territoo^ only) 

IL Excluded schools (not containing students in normal 
^hooling) 



Sanipling was first by schools and then by students within 
schools. A maximum of 7000 students were tested at each 
of the two age levds. With samples of this size it was ex* 
pected that errors of the estimates for means and proport- 
ions would be approximately 3 par cent of a student 
standard deviation. 

Response rate by both schools and students was 
higidy satisfactory. In excess of 90 per cent for each 
State, but below the desired value for the A,C.T. and 
N.T. 

FINDINGS 

The interim report sou^t to examine the extent to which 
lv*> End 14-year-old students in Australian schools were able 
to read^ write and calculate effectively. It was undertaken 
at a time when there was increasing public concern for 
quality and standards in' Australian education not only in 
the popular press and telavision debates but also in 
scholarly writing (Crittendon and D'Cruz, 1976). In the 
sekction of Items and exercises for assessing performance 
m essential tasks, consideration was taken of the skills 
ihat an individuiU at th^se age levels needs not only to 
participate fully in the activitjes of Australian society, 
but also to continue to take part successfully in school . 
learning for his own future development. 

Reading 

TTiere is important evidence from the data collected In 
this suivey that there are no marked differences in the 
level of performance of Australian students in comparison 
with students in Britain and the United States, 

There is, however, some evidence to suggest that 
Australian 14 year^old students have done less well than 
their age mates in New Zealar^d on a simple exercise 
as^^essing reading comprehension. Vet they share a lower 
level of achievement in reading comprehension^ compared 
to 14-year'Old students in New Zealand, with students in 
other countries in the Western World (tliorndike, 1973). 

There is dearly no evidence from this investigation 
to decry the level of achievement in Australian schools. 

Nevertheless, the evidence should lead to concern that 



in nofmal schools in this country there are large numbers at 
Ifryear-old students, appraximatsly 3 per cent of the ?ge 
cohort and amounting to 7500 students, who appear unabie 
to read very simple, senfencas eorrectly. It is estimated that 
^approximately one student per ciassruani has not achieved 
this most elementary level of reading performance by the 
age of 10 years. 

At the H-ycam^ld level our estimates indicate that 
there ^re approxhnati;ly O.H per cent of die age cohort or 
;I000 siucJenfs who have not mastered the ^^^mples^ skills 
of reading. 

The survey buggeiits that unless students have reached 
this threshold ievel of achievcruent in reading by the ages 
of 10 and 14 years tlvey are unabie to obtain the practfce 
necessary' for improvenienc und are severely handicapped, 
in addition, chese estiniates excluded students in special r 
schools (3870 in Queensland in a total primary/secondar>^ 
State enrolment of 333 351, Novamber 1975). 

In the exercises involving reading comprdiensuMi td 
continuous prose, similar to that contained in normal 
school lexis and reference hooks, approximately 25 to 
30 per cent of the students \n both samples were unable 
to provide correct answers to the questions asked. Perform- 
ance was not judged In absolute terms or with respect to 
the norms obtained from standardised tests but compared 
performance with thai of students in other English speak- 
ing countries. ^ 

The evidence suggests that they differ Utile in their 
ability on tasks of reading comprehension from their age- 
mates in Britain and the United States in 1970. but were 
probably niarginaily inferior to students in New Zealand. ^^.^ 

Writing 

The tests used to assess students' writing provided evidence 
not only of performance in the basic skills of writing, 
which are associated with literacy, but also of performance 
in more creative and imagmitive writing tasks, 

Tlie perfoTmance of the 14^year^old students was 
much higher than that of the lO^year-old students on 
similar or identical tasks tested at boih age levels. For 
example^ whereas approximately une-tenth of the 14^year- 
olds were unable to meet the essential requhements ot re- 
cording a teiephone message, more than a quarter of the 
1 0-year-olds were unable to do so. ^ 

Another simple task was writing a personal letter. 
While 76% of layear-oUl students and 92% of 14-year' 
old students completed the. task satisfactorily, some students 
wrote little. It is suggested tfmt some students have not 
attained even the very lowest levels of perfontnance in 
writing. 

On a more complex task, involving writing a letter ot 
application for employment, only 509^^ of the 14-year-oid 
students were able to carry out the task satisfactorily. 

It is not surprising that V.udents at both age levels 
had less difflaihy meeting the requirements of a personal 
letter to a fnend than m including the essential components 
of a more tbnnal letter requesting information. 

The evidence availabfe at this stage of the project 
suggests that some important and quite specinc writing 
tasks, such as the wdtinp of letlers for a defined purpose, 
have not been mastered by large numbers of students. 

At the lO-year-old level on a transcrlpti'- n exercise 
less than 20% of the sample were able tu completi a 
simple tran^riptlon. 

In discussing standards of literacy in Australian 
whools, it is necessary to direct attention more to the 



ERLC 



serious problems of a minority of students than lo the 
satisfactory pertormances of the majority. Some aspects of 
the completion of a form were not understood by sub- 
stantial numbers of students, althou^ the proportions not 
meeting requirements were small In most cases. 

In gensrah the writing of formal letters was poorly 
done and perhaps the most striking result of the various 
writing tasks was that half of the students aged 14 years 
were unable to meet the requirements of a letter applying 
for en\pUjymfent. 

iNUMERATION 

Every school siudent in Australia is expected to master the 
basic skills involved in manipulating numbers to enable him 
to participate successfully in the work of the school and to 
live and work effectively in Australian society. Items in the 
Numeration Tests were categorised on the three dimensions 
of content, ability required and usage to which the skill 
could be put. 

With very few exceptions students irr both samples 
attempted every item in the Numeration Test. The except- 
ions were students from aboriginal schools in the Northern 
Territory. 

The most disturbing finding has been that 4% of the 
14-year-olds did not multiply seven by sbc correctly 
and' S7o did not divide 56 by seven correctly. If we 
accept that not all students should know their number 
facts by the age of 10 years, although some would 
question the wisdom of this, then we must surely 
accept that four years later they should know these 
birsic facts so they can carry out simple calculations. 

The evidence has indicated that among the 14-year- 
old students, many of whom would shordy be leaving 
schooh there are large numbers, es-tlmated at 10 000 
who do not know sirnple subtraction and mulilplrcation 
facts, and an estimated 20 000 who do not know simple 
division facts. 

The fact, too, that Australian 14-year-olds piiiformed 
no better than 13-year-olds in the United States is a matter 
o ' concern. The evidence shows that lO-year-oid students 
could carry out simple calculations invoivlng money 
corrnctly, but did not know theii number facts and could 
not calculate correctly using the four operations in a 
formal svay. This seerr.s to Indicate that what they learnt 
outsfde the school v/as more effectively mastered than 
what they learnt within. 

The consequences of Inadequate mastefy of school 
learning were apparent at the j4-yeapold level where sub- 
stantial proportions were unable to perform successi'ully 
sliglitly more complex calculations involving money. If 
these tasks have not been mastered at school before h 
student were able to leave at tlie age of 15 years, he 
would be very seriously disadvantaged for the remainder 
of his life. 

It has HO! been the purpose of thk hiterim Report 
to derive specific reconvnendations for educational 
practices in Austnaia. What the project has achieved is ' 
the idmtification oj the tasks which are important for 
literacy and numeracy and the estimation, for Australia 
as a whole, of !he proportions and numbers of students 
aged 10 aiid 14 years who are unable to complete these 
tasks success full v. Simple solutions to the problems do 
not exist. If solutions are to be found, they must involve 
the health and welfare of Australian children as well as 
the learning and teaching practices hi all Australian class- 
rooms. 



